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The  paper  presents  a  matheoeticel  study  of  a  time-sharing  system  with  a 
single  server  and  many  queues.  In  each  queue  a  customer  reoelves  one  quantum  of 
service  and  ie  then  sent  to  the  end  of  the  next  queue,  provided  his  service  demand 
has  not  been  completely  satisfied.  When  a  quantum  of  servioe  is  completed  the 
server  attends  to  the  first  customer  in  the  lowest  index  non-empty  queue.  The 
discipline  of  the  highest  indexed  queue  is  '  round-robin' ,  while  all  other  queues 
obey  the  PI/O  rule.  Newly  arrived  customers  join  the  end  of  the  first  queue. 

Mathematical  expressions  for  the  main  performance  measures  are  derived  and 
illustrated  by  graphical  means. 
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A  TIME-SHARING  MOREL  WITH  MANY  QUEUES 
I.  Adiri  and  B.  Ayi -Itzhak 

INTRODUCTION 

One  of  the  main  advantages  of  time-sharing  ie  the  hitter  priority  given  to 
shorter  service  demands  in  oases  where  their  exact  length  is  not  known  in  advance. 

In  the  conventional  single  queue  time-sharing  (round-robin)  model  (referred  to  as 
R.R.l  in  Adiri  and  Avi-Itzhak  [l] ) .  service  is  given  in  small  segments.  Upon 
completion  of  a  service  segment,  the  customer  is  dismissed  (i.e.,  either  leaves  the 
system  or  joins  the  end  of  the  queue,  depending  upon  whether  his  servioe  has  been 
completed  or  not)  and  the  next  in  the  queue  is  admitted.  A  newly  arrived  customer 
joins  the  end  of  the  queue.  In  this  system  the  server  is  ignorant  of  the  amount  of 
service  (number  of  servioe  segments  -  quanta)  already  delivered  to  the  customers 
present  in  the  system.  Thus,  it  would  be  expected  that  the  i-th  response  time  of 
a  customer  (time  between  (i-l)-th  and  i-th  admissions  to  service)  is  not  strongly 
dependent  upon  i  .  It  follows  that  the  expected  total  response  time  (time  in  the 
system)  of  a  customer  is  approximately  an  increasing  linear  function  of  his  service- 
demand  length.  This  is  demonstrated  in  Figure  1,  constructed  on  the  basis  of  exact 
closed  form  results  obtained  in  reference  [l].  It  relates  to  the  steady  state 
situation  of  an  R.R.l  model  where  arrivals  are  assumed  to  behave  as  a  homogeneous 
Poisson  process  with  intensity  A,  service  demand  lengths  have  a  negative  exponential 
distribution  with  mean  l/u,  and  quantum  length  is  *  ♦  C,  where  \  is  the  set-up 
time  and  0  the  service  segment  (quantum  processing  time). 

One  weakness  of  time-sharing  systems,  inherent  in  the  R.R.l  model,  ie 
sensitivity  to  overloading  by  customers  with  long  service  demands  (long  processing 
times).  The  presence  of  customers  with  long  service  demands  increases  the  waiting 
times  of  all  customers  in  the  system,  and  ±n  cases  of  overloading  (saturation)  a 
demand  cannot  be  satisfied  in  a  finite  time,  however  short  it  may  be.  On  the  other 
hand,  there  is  no  sufficient  discouragement  of  customers  with  long  service  demands, 
since  waiting  time  increases  linearly  with  demand  length.  An  actual  time-sharing 
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system  is  frequently  overloaded  during  peak  hours  and  underexploited  during  the  rest 
of  the  day.  It  is  desirable  to  automatically  transfer  long  service  demands,,  placed 
during  peak  hours,  to  less  loaded  hours  of  the  day,  or  even  discourage  them  completely 
and  force  them  to  use  batch  processing  during  night  hours.  What  is  needed  is  thus, 
a  system  with  the  following  features:  (i)  waiting  times  of  short  demands  are  less 
sensitive  to  the  presence  of  long  demands  than  in  the  simple  round-robin  discipline , 

(ii)  short  demands  satisfied  even  under  conditions  of  overloading  (the  higher  the 
overloading,  the  shorter  the  demand  must  be  in  order  to  be  satisfied )  j  and 

(iii)  effective  discouragement  of  long  demands  during  peak  hours,  by  postponing  their 
service  to  non-peak  hours.  Needless  to  say,  the  above  muBt  be  realised  without 
prior  knowledge  of  demand  lengths. 

The  R.R.r.  model  is  proposed  as  a  solution  along  the  above  lines.  It  comprises 
one  server  and  r  queues  all  of  which,  except  the  r-th •  observe  the  FIFO  rule,  while 
the  r-th  queue  is  operated  as  an  R.R.l.  A  newly  arrived  customer  joins  the  end  of  the 
first  queue  where,  in  due  course,  he  receives  a  certain  amount  of  service  (processing), 
following  which  he  either  departs  or  joins  the  end  of  the  second  queue  for  additional 
service  The  server,  after  completing  a  service  qu&.tum,  selects  the  first  customer 
in  the  lowest  index  (highest  priority)  queue.  The  limit  case  where  r  =  o*  ,  i  e 
R,R.*o  ,  has  been  first  suggested  and  studied  by  Schrage  L']. 

The  number  of  queues,  r  ,  and  the  quantum  processing  time  for  each  queue.  0  , 
nay  serve  as  control  rarametera  of  the  system 

MATHEMATICAL  MODEL  -  R  R.  r 

Customers  arrive  at  a  single  server  facility  according  to  e.  aomogenecu9 
Poisson  process  with  intensity  X  .  Service  times  (as  demanded  by  customer?)  are 
independent  random  variables  identically  distributed  exponentially  with  mean  l/h 
The  waiting  line  consists  of  r  separate  queues.  A  newly  arrived  customer  joins 
the  end  of  the  first  queue  j  upon  admittance  to  service  he  is  eligible  for  8^  units 
of  service  time.  If  his  service  demand  is  shorter  than  8^,  he  completes  his  service 
and  leaves  the  system,  otherwise  he  receives  8^  units  of  service  time  and  joins 
the  end  of  the  second  queue.  In  general,  at  the  i-th  queue  (i=l,2, . . .  ,r-l)  the 
customer  is  eligible  for  8.  units  of  service  time  during  which  he  may  complete  his 
service  and  leave  the  system,  or  join  the  end  of  the  ( i+1  )-th  queue  after  receiving 

8  unite  of  service  time.  A  customer  in  the  r-th  queue  who  does  nut  couiple.e  his 
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lervice  within  ©^  service  time  unite  re-joins  the  end  of  the  same  queue,  Having 
completed  a  servioe  quantum  at  any  one  of  the  queues,  the  server  admits  to  service 
■die  customer  who  is  first  in  the  lowest  index  non-empty  queue.  We  assume  that 
each  quantum  starts  with  a  set-up  time  due  to  swapping,  housekeeping  etc.  The  i-th 
quantum  thus  comprises  two  elements!  a  set-up  time  of  length  i  and  a  processing 
time  not  exceeding  ©  units. 


Husy  Period  and  Backlog 
Let: 
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1=1,2,..., 


(1) 

(2) 

(3) 


where  (l-a^)  is  the  probability  of  service  being  completed  in  the  i-th  queue,  i*  r 
for  i>r,  and  ^  are  defined  as  equal  to  ©r  and  ,  respectively.  Hence 
for  i>  r  we  have  =  ar>  *  Hr  and  qt  ■  qr  ♦  (i-r)(©r*xr). 

The  length  of  a  quantum  devoted  to  a  customer  in  the  i-th  ( i=l .  2  „ .  .  r )  queue 
behaves  as  a  random  variable  which  we  shall  denote  by 


®i  +  Xi 


with  probability  cr 
with  probability  l-o^ 


<4) 


where  is  a  r.v.  possessing  the  density: 

V*>  ‘  ^ 

For  l>  r.  Q,d2f  Q  and  D.dSf  D  . 

i  r  l  r 


i=l,2,...,r. 


(5) 


Within  each  queue,  quantum  lengths  are  mutually  independent  and  also  independent 
of  the  number  of  customers  present  in  the  various  queues.  This  property  is  general 
for  all  time  distributions,  exoept  for  the  r-th  queue  where  it  may  not  hold  for  non¬ 
exponential  service  times.  The  quanta  in  the  different  queues  are  mutually  independent 
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Let  the  r.v.  S  denote  the  total  tine  ( Including  aet-upe)  devoted  hy  the  eerver  to 
a  customer. 
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with  probability  1  - 


qi  ♦  D  with  probability  pjU  -  °i4l) 

i=l 1 2 1 ... . 


(6) 


The  backlog  and  the  busy  period  of  the  R.R.r.  model  behave  as  in  a  M/g/  1  model 
with  service  times  distributed  as  S.  This  equivalence  holds  also  for  R.R.l  systems 
with  general  time  distributions,  where  S  is  defined  as  the  total  time  devoted  to 
a  customer. 


Total  Response  Time 

The  total  response  time  of  a  customer  is  defined  as  ibe  total  time  he  spends 
in  the  system  from  arrival  to  departure. 


Let  (reO.,2 . )  denote  the  number  of  customers  in  the  R.R.r  system  at 

the  moment  of  the  n-th  departure.  Consider  now  a  similar  R.R.ee  model  with  the 
same  system  parameters  except  that  for  i>r,  °1  =  ®r  ^  \  *  Tr»  and  Xn 
denote  the  number  of  customers  in  the  R.R.O®  system  at  the  moment  of  the  n-th 
departure.  Clearly,  X^  and  X^  are  equal  in  distribution.  This  is  a  result  of 
the  premise  that  service  times  are  exponentially  distributed,  and  is  explained  as 
*'cllows:  Up  to  and  including  the  (r-l)-th  queue,  both  systems  are  identical;  the 
input  processes  into  their  respective  r-th  queues  are  also  identical,  and  the  departure 
process  from  the  r-th  queue  of  the  R.R.r  model  is  statistically  identical  to  that  from 
queues  r,  rvl,...,  of  the  R.R.oe  model.  According  to  Little's  Theorem  ,  the 
steady  state  expectation  of  total  response  time  (denoted  by  E(t)),  is  identical  in 
both  systems. 


Using  Sehrage's  results  [2]  for  the  R.R.oe  model,  we  obtain 

e(t) 
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In  this  expression  E(T |L»{)  is  the  totel  response  tine  expectation  of  a 

customer  who  demands  (  service  time  units  in  the  R.R.ae  model,  a  -B  »1, 

0  0 

vVv0,  “d 

with  probability  p^Cl-a^),  i»l,2,...,n 

na*l,2 . 


»n  s(4-'D‘ 

l  % 


with  probability  p_  ,  (8) 


I1(V  ■  Jiei-l(l^l)(WE(Di}) 

B(<}  “  fa  *  it  Pi-l(1-a1)(<1i-l  +  2qi-l  E(V  ♦  E(Di)) 

n=l,2,.. . , 


(9) 


Conditional  Total  Response  Time  -  R.R.r 

The  total  steady  state  response  tine  of  a  customer  with  service  requirement  1 
is  denoted  by  T (f).  This  quantity  will  bs  referred  to  as  the  conditional  total 
response  tine. 


RR.eO 


The  behavior  of  the  first  (r-l)  queues  is  the  same  in  both  the  R.R.r  and  the 
systems.  Thus  for  <*  ©i  we  may  use  Schrage’s  results  [2] . 


E(T(f )) 
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vhere  n  is  an  integer  such  that 

iSl  ®i  <  ^  ^  ®i  *  ^ 

.  .  r-l 

‘Customers  with  service  time  ©^  reach  the  r-th  queue,  where  they  circulate 

until  departure.  We  define  the  i-th  (i“2,3,...,)  response  time  of  a  customer 

; denoted  by  T.J  as  the  time  elapsing  between  his  (i-l)-th  and  (i-th)  admissions 
1  a  1-1 

to  service,  assuming  that  f  ©^  .  Similarly,  Tj  is  the  time  elapsing  between 
his  arrival  and  first  admission.  Let  (K^+l)  denote  the  number  of  customers  present 
at  the  time  of  the  i-th  admission  of  a  customer  to  service.  For  i»r,r+l,...,  (K^+l) 
is  their  number  in  the  r-th  queue  at  the  moment  of  an  l-th  admission.  The  i-th 
response  time  expectation,  I^),  (i-r+l,r+2 . )  is  obtained  as: 
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®r  4  *r  ♦  g(lCl-l),(Qr) 


i-rel,r*2, .. . , 


where  r£2. 

The  argument  supporting  Eq.  (12)  is  that  T  say  be  viewed  as  a  busy  period 
starting  with  initial  expected  backlog  of  magnitude  (O^e  B(Ki_j)E(Qr))  in  a 
10»/l  system  where  the  arrival  race  is  X  and  aervice  times  are  distributed  aa 

°r-i- 

For  baves 

<(T(D)  -  A  ttoj  ♦  <  -  A  ®i  ♦  *n  •  (13) 

Substitution  of  Eq.  (12)  yields  for  n  jr: 

r  (n-r)(©  «  )  ♦  «(0£  E(K  ) 

■(*«))  -  isfijt - S-E - L« — L  ♦ 

i_1  1  i  -  XE(ur_1) 

+  /’3l®i  +  ,r  •  (M) 

In  this  expression  both  sums  are  unknown.  We  sould  like  to  express  them  as  functions 

of  E(K  ).  The  following  recursive  relation  is  readily  shown  to  hold  for  i>  r, 
r 

E(Ki)  .  *(T1)»0Ik.1  ♦  E(Ki_1)ar  .  (l5J 

From  Eqs.  ( 12 )  and  (15)  we  obtain: 

3r  E(V  *  (E(Kr) "  i'  -  r~ +  (i  -  r5  *  (16; 


X0  (0  +  x  ) 

^r-1  r  r 


b  =  a 
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Let  T  be  the  tin#  •lapsing  br  t  ssn  the  arrival  of  a  custonar  whose  service  time 
0  r-1 

•xoeeda  j:,  a  and  next  admission  of  a  custonar  in  ths  r-th  queue ;  and  1st  Z 
denote  the  number  of  customers  in  ths  r-th  queue  when  a  new  customer  joins  it.  The 
time  elapsing  between  admission  of  a  customer  from  ths  r-th  queue  until  the  server 
is  again  ready  to  admit  a  customer  from  it  behaves  ae  a  busy  period  of  a  M/c/l  model, 
where  servlos  tinea  are  distributed  as  U  ^  and  ths  starting  backlog  is  distributed 


as 


Q^.  Bearing  in  mind  the  definitions  of  Tq  and  Z,  we  thus  have. 
r  E(Z)e(Q  ) 

i&l  E(V  ■  E(Te)  4  r-"KEtir"""I  • 

r-1 

The  expectation  of  T  is  obtained  by  using  Schrags's  [2]  approach. 


(19) 


e(t  ) 


XE(t^_x)  *  XE(Q2  >*r-l^  -  °r> 

2(1  -  XE^^))2 


V-l 

4rrr 


(20) 


Since  arrivals  and  departures  take  place  one  at  a  time,  the  number  left  in  the  r-th 
queue  by  a  departing  customer  must  be  distributed  as  Z.  (This  is  a  steady  state 
argument).  Let  X  be  the  number  present  in  the  r-th  queue  at  the  moment  when  a 
customer  of  this  queue  is  admitted  to  service,  then 


I(Z)  -  E(X)  -  1  , 
On  the  other  hand,  we  havet 


for  r  9  2 


(21) 


E(X)  -  (1  -  ar)  Jk  E(K1)a^r  *  1  (22) 

Substituting  of  Eqe.  (l2),  (15)  end  (2l)  in  (22),  eumaation  and  substitution  in  (2l) 


yieldt 


E(Z) 


(23) 


Substituting  Iqs.  (20)  and  (23)  in  (l9)>  we  obtain: 
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2(l  _  XE(U  ,))2  1  " 


r-1 


E(Qr) 


+  (r^rr *  rrjT  E(Kr})  i-=~»!rn"~7 
r  r  r-1 


(24) 


Substituting  Eqs.  ( 16)  and  (24)  in  (14),  we  have  E(t(0)  expressed  as  a  function 
of  E(Kr)  and  of  the  various  parameters  of  the  process. 

»<*£.!>  ♦  XEtQ^^/d  .  „r)  Vl 


E(T(f)) 


b  -  a 


r  Hr-1 

2(1  - 


2  1  -  ^(Vl} 

rs - -  f(a  *  +  (l  -  a  )E(k  ))/(l  -  a  b)  + 

X0r-1  l  r  r  r  r 

(E(Kp)  -  s/(l  -  b))(l  -  bn-r)/(l  -  b)  +  (n  -  rW(l  -  b)J 


♦  (n  -  rJa/CXe^)  ♦  I  -  ^  ♦  tf 
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E(K  )  is  obtainable  from: 
r 


E(T)  -  Je(T®)  na“U<<i t  . 


(26) 


where  E(T)  being  given  in  Eq.  (7),  B(t( f ) )  for  n<r  by  Eq.  (10)  and  for  n>r 

by  Eq.  (25).  The  result  obtained  for  E(K  )  is  fairly  complicated  in  form: 

r 

!<v '  *  rrt <rh;  - 
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(r^_  (It 


Z - 3  vxrT 

(1  -  u  )  r-1 
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b  -  a 

~ T 


„  ,  rxE(u;  j  *  xe(q;)p  ./(1-0  ) 

r ^  1  r  r-l  r  1^1 _ r_^ 

1  '  “r  2(1  -  XE(0_  ,))2 


r-1 


b  -  a  a  a 
r  /  r 


*  1  -  &t? '  'vf <r^?  ■ 


.  (27) 
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DISCUSSION 

The  complexity  of  the  mathematical  formulae  rules  out  direct  analysis  and 
discussion  of  the  results,  and  therefore  the  authors  have  decided  to  illustrate  the 
main  features  of  the  model  by  means  of  graphs. 

Figures  2  and  3  show,  for  different  values  of  r  ,  the  functional  relation 
between  the  total  response  time  of  a  customer  and  the  length  of  his  service  time. 

As  r  increases  waiting  of  short  demands  decreases  while  waiting  of  long  demands 

increases.  In  these  examples  ©i  -  6,  i=l,2 . .  hence  the  unconditional  expected 

total  response  time  is  independent  of  r  .  Obviously,  any  decrease  in  waiting  time 
of  short  demands  ..is  obtained  at  the  expense  of  the  long  demands.  The  terms  "short 
demand"  and  "long  demand"  are  used  here  qualitatively.  In  a  real  situation  it  suffices 
to  define  an  overall  objective  function  and  optimise  with  respeot  to  the  control 
parameters  r  and  0.  It  should  be  noted  that  the  numerical  results  for  r  -  1 
were  obtained  by  using  the  mathematical  results  of  reference  [l] ,  since  the  R.R.r 
model  treated  in  this  paper  does  not  include  the  case  r  =  1. 

Another  way  of  increasing  priority  to  short  customers  is  by  increasing  the 
magnitude  of  0  ,  (assuming  0^  «*  0,  i=l,2,. . .  ,r).  This  is  illustrated  in  Figures  4 
and  5  where  r  Is  kept  constant  for  different  values  of  8  .  Note  that  when  8 
exceeds  a  certain  magnitude  priority  to  short  services  is  reduced  and  the  queue  dis¬ 
cipline  tends  to  FIFO.  In  Figure  5  the  load  on  the  station  is  relatively  low 
(x/p  ■  0.5).  Consequently,  the  effect  of  increasing  8  is  not  as  noticeable  as  in 
Figure  4  (a/u  -  0.85).  In  both  figures  the  time  losses,  represented  by  set-upe, 
decrease  when  8  is  increased,  since  the  value  of  t  (assuming  v  =  i=l , 2 , . . . , r ) 

is  kept  oonstant. 

In  the  preceding  examples  identical  values  of  8^  were  used  in  all  queues, 

i.e.,  *  8,  i«l,2 . r.  The  priority  given  to  short  demands  may  be  increased 

at  the  expense  of  the  long  demands,  by  using  a  decreasing  sequence  (8^,  i»l,2,...,r) 

of  quantum  processing  times.  Here  an  R.R.r  system  with  a  fixed  quantum  processing 
time  (equaling  8  in  all  queues)  is  concerned  with  equivalent  system  in  which 

It  is  assumed  that  set-up  times  are  the  same  constant  for 


is  an  arbitrary  sequence. 
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all  queues  In  both  systems,  i.e.,  v  ■=  t,  1*1,2 . .  and  furthermore,  that  all 

other  parameters,  except  for  the  quantum  processing  times,  are  identical  in  both 
systems.  For  the  comparison  to  be  meaningful,  the  expected  time  losses  (represented 
by  set-ups)  per  service  must  be  equal  in  both  systems.  This  implies  that  the 
expected  number  of  quanta  per  service  ie  the  same  in  both.  Expressing  this  equiva¬ 
lence  mathematically,  we  have: 


l  - 


3}  iP^d  -  *,)  *  er_xd  -  «r>  X  ia' 


i=l 

Summation  yields 


i-r 

r 


(28) 


~qs  "  Ji  i0i-i(1  ‘  ai}  ^  ^r-i +  fer  • 

1  -  e  ^  r 


(29) 


For  any  given  sequence  (8^,  i*l,2,...,r)  the  value  of  0  can  be  uniquely  deter¬ 
mined  using  Eq.  (29). 

Figure  6  illustrates  an  example  where  the  sequence  (0^,  i=l,2,...,r)  is  of 

the  form  ©j+1  *  0.95©^  i=l,2 . r-1  and  ©^  =  10,  r  ■  50.  The  equivalent  value  of  © 

for  the  system  where  ©i  *  ©,  i=l,2,...,r  is  ©  =>  2.81. 

As  mentioned  in  the  introduction!!  during  peak-hours  (oversaturation)  the 
h.R.r  system  still  satisfies  short  demands,  while  service  to  long  demands  is  auto¬ 
matically  postponed  to  non-peak  hours.  This  is  shown  graphically  in  Figure  7. 

Table  1  supplements  Figure  7  by  giving  the  longest  demand  that  can  be  still  served 
in  a  finite  time  for  each  traffic  intensity. 


fxpected  totoi  response  t  ime  for  o  /spectre*  tezV  n c^asw  tme  for  a 

service  requirement  of  length  f-jh  seconds.  sernce  requirement  qf  fcngffj  /-*?  s 
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figure*  frcected  Joto/  Response  Time  for  o  Service 
Requirement  of  length  (  os  o  function  of  1. 
(tor  different  va/uesof  r) 


-  u  - 


figure*  ficoected  Total  Response  T/me  fora  Service 
Requirement  of  length  £  as  a  Function  of  £ 
(For  different  tai/es  ofe) 


/ 
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Tabla  1 


:  Largest  Satisfied  Demand  as  a  Function  of  Traffic  Intensity. 

(r  -  100,  n  =  0.01  aec-1,  =  0.1  sea,  =  2  sec,  i=l,2 . r) 


p  =  XE(S)* 

□umber  of 
unsaturated  queues 

largest  satisfied 
demand  in  seconds 

0.9 

0.95 

100 

all  demands 

1.0 

1.05 

99 

198 

1.1 

1.16 

99 

196 

1.2 

1.26 

71' 

156 

1.3 

1.37 

65 

130 

1.4 

1.47 

56 

112 

1.5 

1.58 

50 

100 

2.0 

2.10 

32 

64 

5-0 

5.25 

10 

20 

*Note  that  the  steady  state  condition  is  P  <  1. 
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